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ABSTRACT 



An important example of an event which obeys the geometric 
probability law with parameter 0 is the number of cycles required 
to obtain the first failure of an item, where the success of each 
cycle is independent with probability of success 0. 

The true probability of success, in manufactured items, is 
usually unknown and must be estimated on the basis of observed 
data obtained from a test of sample items. An important estimator 
for this probability is the unbiased estimator, defined as that 
estimator whose expected value equals the true value of the para- 
meter, In this study, an unbiased estimator for 0 is derived. 

This estimator is based on the results of a series of independent 
items, each cycled to first failure. 

Series approximations for the variance of this estimator are 
derived, and some values of the variance are tabled for those 
cases thought to be of special interest. 
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TABLE OF SYMBOLS AND ABBREVIATIONS 



Symbol 

0 

n 

s 

Ns 

Ns 

R 



Description 

Probability of success of a single cycle 
Number of items cycled till first failure 
Total successful cycles completed in n tests 
The number of ways n tests can sum to s successes 
The unbiased estimator for 0 
The product ( Ng Gg ) 

The ratio 

0 



iv 



1 . 



Introduction, 



The geometric probability law with parameter 0, where 
0 ^ 0 ^ 1, is specified by the probability mass functions 
p(x) = 0^ (1 - 0) for X = Oj 1, 2, 

= 0 Otherwise, 

where x is the number of successful cycles to first failure of 
one item. 

When n independent items are cycled to first failure, the 
probability of each ordered event is 

n ^ _ 

I fO^^l-9) = 0 (1-0)^ where s = , 

The probability of exactly s successes is thus the union of 
all events with exactly s successes. The number of such events is 
the number of ways n tests can sum to s successes « Therefores 
p(s) = Ng0^(l-e)" for s = 0, 1, 1, 3, ...... 

= 0 otherwise. 

A 

Since N, M, and 0 are functions of both n and s, the subscript 
(n,s) is necessary to uniquely identify the value. However, since 
n is a known variable which is fixed prior to testing, the abbre- 
viated subscript s will be used. 

* •‘k k k k k 
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2. 



Derivation of the Unbiased Estimator, 



By definition, and estimator 9g is unbiased if its expected 
value equals the true value of 0, where the expected value E(0g) 
is defined by 

A 

E(0g) = Z. ®s P(s) over all s such that p(s)>0. 
s 

Thus, ^ is an unbiased estimator for 0 if and only if 
s 

oo 

0 = ( 1 - 0 )’^ 

StO 

= 21 ^s • 

By expanding the (1-0)’^ term, the summation becomes 



11 


Ms 0®| 




(?)« 0 


jje2 


5^0 


1 






= Me 


[-( 




+ ("le^ 


+(-l)^'^( + (-1)” 0" 




[-( 


y 


+ [y 


H-iry.y + (-1)" 8"-^' 


+ »2 


[9^.( 


?)q3 


. (1)8^ 






etc. 

Rearranging terms as coefficients of a power series in 0 , we obtain 

8= [m„] 

+ » [»i -(iK] 

+ - (5;)mi +(?)m„] 

+ 93[m3 - (?)m2 +(5)mi. - (5)mo] 

+ - - - etc., until the 0’^th term. Then, 



2 



+ 0 



[“„ ■ (?K-i + - - + <-1)"'^ 

[»n+l ■ (l)w„ ■*■-- + (n-l )»'2 + (-1)" 

+ [»n+2 - ("i)m„+i + - - + + M>" Ma] 

+ ----- etc. 

By equating coefficients: [^o] ~ ^ 

[^1 - (iK] = 

All remaining coefficients are zero. 

Solving for Mg (s = 0, 1, 2, ), the following table of equations 

is produced: 

Mo = 0 



= 1 



Mo = 






1)^2 



M 3 = 

M 4 

Me = IV IM 



= (^)m3 - 



( 2)^1 

(2)^2 +(3)^1 



ir^4 



5;m3 + 



(?) 



Example of table 
with n = 



Mo 



Me = (i)m5 - (2)m4 + (5)m3 - (^)M2 + (§)Mi 



M? ' (i)m 6 - 


(5)w5 


+ (")«4 


- ("Imj + ( 


?)W 2 !- {b)% 

j 


Mg - (?)m 7 - 
• « 


( 2 )% 

• 

• 


+ (")«5 


- (IK + ( 


( 6)«2 + (9)Mi 
• 1 ♦ • 

« I » » 


• ♦ 

• 


• 


• 


• 


el • e 



( 1 ) 



and so forth. 



3 



Initial numerical solutions for M are as follows: 

s 

Mo = 0 

= 1 
M 2 = n 

M3 - (J)„ - (5) = - ("«) 

" (?f") - (2)" + (?) - 



- ("?) 



Thus, Mg can be written as the expression 

Mg = for s = 0, 1, 2, 3, 4. 

The proof that this expression holds for all s will be by induction. 
The assumption: M^^ = for i = 0, 1, 2, 3, - - (k-1) 

To prove: Mj<. = • 

From equations (1), Mj^ can be written as the following summation of 
the M^: 

Mk - 1 = - [i (-1)' 

= -[i (- 0 ^ (tA ■ 

i * 0 

But “ (k+l) ’ Performing this transformation, we have 





i /n\ f/n+k-i-l\ /n+k-i-2\ 


/n+k-2 1 


Mk = - 


^ ( i)j( n / - { n ) 


’ - 1 k-1 / 









Let X = n+k-1, and Y = n+k-2. Then, 

»k= I<-oM?)(V) (?)(";') ^ (“Si") 



L~ O 
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By use of the following combinatorial identity: 



2 (i) (V) " 

l-o 

which is derived in Appendix I, the desired solution is obtained. 




The number of ways n tests can sum to s successes, 




and the value for Mg ^ 




which was just proved, provides the derivation for 0g . 



©s 




(n+s-2)I (n-1)! si 
(n-1)! (s-1)! (n+s-l)I 



0c 



n+s-1 

0 



for s > 0. 
for s = 0. 



( 4 ) 



Thus, 0g is equal to the number of successful cycles, divided by the 



total number of cycles minus one. 



if if if if if if if if 
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3. Derivation of the Variance. 

The variance of a random variable is defined by 
Var(X) = E(X^) - E^(X). 

Therefore, the variance for the unbiased estimator 0g can be 
obtained by solving the following equation: 

Var(0g) = E(0s) - 

- A ^ 

Equation (4) gives the value for 0 such that E(0 ) = 0, Therefore, 

S o 

E^(0g) = 0^, However, since the derivation of E(0g) provides a 
formula which is useful in deriving the second moment E(0g), the 
reverse computation will be shown. 



" 2 Ns (1-0)^' = (1-0)'' 2 

- a-®)- i ■ 






s*o 



Since the s=0 term equals zero, the summation index can be changed, 
and 






e" 



e I ( 9= 



5iO 5-0 

i 

By use of the following identity (also derived in Appendix T) ^ namely 



in 






L^O 



the summation ^ 
s-o 



n-l+slgS _ 



(1-0) 
1 



N 



and 



Thus , 



I n?) 



(i-e) 

0 






(6) 



5= O 



n 



. g-Q) Q 






" (l_e)n ' = e . and E"(§g) = 0". (7) 
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Similarly, to find the second moment^ we note that 



A 2 A / s n 

(ep = ^ (Og) Ng e (1-9)'" 



.2 



SsQ 






( 8 ) 



s-o 



But 



= - / s W n-1 \ + /_s__\ 
[ n+s-1/ ^n+s - 1 / \ n+s - 1 / 



Substituting this expression into equation (8), and using equation 
(6), we obtain 

gS 

\+s-l}{ n-1 / ^ 



E(S^ - (i-e)" I - (1-9)" t(w 

Sto 5*0 






5:0 

Multiplying by a factor ^n-1 ? '^e have 



E(9s) = 






s*o 



= 0 - e(n-l) R 



-n 



2 ^ 1 ( n*^s - 2 4 qH+s - 1 

n+s-1 I n-1 I 
5«0 ' ‘ 



= 9 - G(n-l) R'^ f(G) , 

where f(0)= f ^n - 1 ^ ^ 



( 9 ) 



( 10 ) 



5*0 
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Differentiating equation (10), we have 



f'(0) = g(0) 



2 



5=0 



n+s-1 

n+s-1 







5=0 




2 



Thus, by substituting equation (6)^ we obtain 



g(0) = 



0 



n-1 



( 1 - 0 )" • 



This expression must be integrated to obtain f(0). Thus, 
f(e) = fg(9) + C = G(0) + C , 



where : 



G(0) = 



f 0"-^ 
"J (1-e)" 



d0 . 



Integrating by parts, letting u = 0’^"^ and dv = (l-0)”'^d0, 





f_0_l 


n-1 

1 - -i-l 


f jlI 






n-1 1 


1 l-0j 


1 n-2 ' 


i l-0i 


1 n-3 1 


> 1-0/ 



n-3 



+ (-1)""^^ iflTe) in(i-0). (ii) 



To find the constant C, equations (9) and (11) are evaluated at 
0=0. The constant equals the difference f(0) - G(0) for all 0. 



f(0) = 0, and 
G(0) = + ln(l) = 0. 
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Thus the constant C is zero. Therefore^ 



f(9) = ^ R’^'^ 

^ ■' n-1 n-2 n-3 



+ (-1)" ^ R^ 



+ 2 ^ ln(l-9). (12) 

^2 

Substituting equation (12) into (9) gives the solution for £(9^). 



E(9h = e - e(ti-l) f -ij R - ~ R^ + ^ R^ 



+ (-1)’^'^ I R^^"^ + (-l)"^ R’^"^ + (-1)’^ r" ln(l-9) 



. (13) 



Substituting equations (13) and (7) into equation (5) provides the 
derivation of the variance. 



Var(0g) = 0 i(l-e) - (n- 






1 1 2 1 „3 

n-1 n-z n-j 



+ (-1)"'^ i r’^"^ + (-1)\’^'^ + (-l)’^R‘^ln(l-9) 



(14) 



>V 'k if ic ’k k k k k 
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4. Numerical Analysis of Variance. 

The equation (14) for Var(0g) lends itself nicely to re- 
cursive numerical analysis. If the alternating series in the 
square brackets is considered, for various values of n, we have 

n=2 R + R^ln(l-e) = R(1 + Rln(l-9)) , 

n=3 j R - R^ - R^ln(l-e) = R( i - R(1 + R ln(l-9))) , 

n=4 V R - T + R^ln(l-9) = 

(15) 

R( j - R( I - R(1 + R ln(l-9)))). 

and so forth. If RW^ is set equal the sum of the series in equa- 
tions (15), Q is defined as -R, and L = (1 + R ln(l-9)), then 

W 2 = L , 

W 3 = LQ + i , 

= (LQ + J )Q + j , 

= ((LQ + I )Q + I )Q + ^ ; etc. 

A 

Var(0^) can be re-written as 

Var(9g) = 9 [(1-9) - (n-1) R W„] , 

where Wn is defined by the following recursi'je formula, 

W 2 = (1 + R ln(l-9)), and 

W = W 1 (-R) + -t- , 
n n -1 ^ ' n -1 
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A 

Appendix II provides tables of Var (0^) for 15 values of 0 
and representative values of n between one and 50* input data 
with nine-place accuracy was used in compiling these values* 

Any output error (E^) in this data is a result of the natural 
limitations on input data degrees of significance 3 and occurs in 
the bracket summation. We have 



= +(- 1 )*'^'^(. 6666 ---+€ 3 ) - 4 - (- 1 )^(. 2 ) 

+ (-1)’^‘^(.25) + (-1)^(.333--+ €, ) R^‘^ 

+ (-1)’^ r’^ (In(l-e) + €^) . 

Thus, for input data significance of degree ^ 3, 



E„ = (-1) 



"[r" 



+ r” + R 



n -6 n ~7 n“9 

" - R R ^ 



etc . 



For values of 0 > *5 (i^e.^ for values of R ^ 1*0), the corn- 

puted variance has approximately the same degree of accuracy as the 
input data. For smaller values of 0, however, rapidly exceeds 

the value of the variance as n increases. 

As an example, with an input accuracy to nine decimal places, 

0 = 0,05, R = 19, and n = 6 ^ 



Eq'^(0.€^x L0'^)(19^) == (0.€^x 10 "^) (4.7x10^) ^ (4.7xl0'^) , 



but the variance at n = 6 is less than 9 x 10 The tables of 

Appendix II indicate this decrease in accuracy for values of © C 0.5o 
Since 0 is normally larger than 0,5 for items that are cycled 
to failure, the inherent error term for small 0 is expected to place 
little restriction upon the use of the tables. 
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APPENDIX I 

PROOF OF COMBINATORIAL IDENTITIES 

A. To prove: 



i (-0^ (")P = 

»»o 



Each 



(‘;1 



term can be written as a linear combination of 






terms, where j = 0, 1, 2, , n, by successive application of the 

rule : 

Thus : 

(5) " (s)(V) * (;)(V) - - - - 

(V)= (V)(Y)MV)(V)----+ (s:l)(vj 



(Y) = 









(etc., until finally;) 






Thus ; 



i-O 

(S)(S)(V) - (S)(?)(V) + (o)(5)5i 

+(?)(V)fr 



+ -- 



+ . . - 






etc. 
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(to the last term) (-1)" 

By summing on like coefficients, V7e have 



1 ^ 2 

^=/ 






1 + 






It will now be shown that the summation in the square brackets 
equals zero. 

/nWn-i\ ^ nj (n- i ) ! , ri ^/rWn\ 

(i)\r-i| i! (n-i) I (r-i)! (n-r) ! r! (i)[r) ' 

Thus, the summation in the square brackets can be written as 



t'O 



But this equals zero, as can be seen from 



(x+y)’^ = J x’^"^ y + 



(r) 



Letting x = 1 and y = -1, the solution is provided 



(5)-(ih{5) = i 0 



it it it it 



B . To prove : 



' • * 

i’rO L -0 



( 1 -©) 



■^+1 
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This proof can be seen from the successive differentiation of 



1 

1-0 



( 1 - 0)2 







L-O 



= f (1 + i) ©i ^ 

l-o 



( 1 - 0)2 

etc. By induction. 



2 




(1 






t-0 



it it it it it it it it it 
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APPENDIX II 



TABLES OF VARIANCE 



n 


9 = .999 


9 = .99 


9 = .95 


CD 

II 

VD 

O 


9 = .80 


1 


00099900 


.00990000 


.04750000 


,09000000 


.16000000 


2 


00000591 


.00036517 


.00538351 


.01558428 


.04047190 


3 


00000099 


.00009262 


.00193332 


.00653683 


.01976405 


4 


' less \ 




.00004860 


.00109737 


.00391053 


.01258848 


5 


than 




.00003268 


.00075632 


.00275400 


.00913717 


6 


10 '^ i 




.00002459 


.00057524 


.00211750 


.00714463 


7 






.00001970 


.00046367 


.00171767 


.00585661 


8 






.00001643 


.00038820 


.00144401 


.00495849 


9 






.00001410 


.00033379 


.00124521 


.00429757 


10 






.00001234 


.00029274 


.00109435 


.00379131 


12 






.00000988 


,00023491 


.00088071 


.00306739 


14 






.00000824 


.00019614 


.00073676 


,00257505 


16 






.00000706 


.00016835 


.00063321 


.00221867 


18 






.00000618 


.00014746 


.00055516 


.00194882 


20 






.00000549 


.00013118 


.00049423 


.00173744 


25 






.00000430 


.00010279 


.00038780 


.00136670 


30 






.00000353 


.00008451 


.00031907 


.00112630 


35 






.00000300 


.00007175 


.00027107 


.00095780 


40 






.00000260 


.00006233 


,00023557 


.00083315 


45 






.00000230 


.00005510 


.00020831 


.00073720 


50 






.00000206 


.00004937 


.00018671 


.00066107 
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n 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

12 

14 

16 

18 

20 

25 

30 

35 

40 

45 

50 



0 = .70 


0 = .60 


CD 

II 

e 

Ln 

o 


0 = .40 


0 = .30 


.21000000 


. 24000000 


.25000000 


. 24000000 


.21000000 


.06479650 


,08434420 


.09657359 


.09974306 


.09256908 


.03446014 


.04754107 


.05685282 


.06077082 


.05801098 


.02284705 


.03245893 


.03972077 


.0432656 


.0419615 


.01694454 


.02448095 


.03037231 


.0334686 


.0327862 


.01342257 


.01959921 


,02453463 


.0272462 


.0268734 


.01109697 


.01632064 


.02055846 


.0229567 


.022754 


.00945152 


.01397284 


.01768180 


.019825 


.019723 


.00822783 


.01221117 


.01550652 


.017441 


.017402 


.00728301 


.01084162 


.01380517 


.015567 


.01556 


.00592068 


.00885224 


.01131743 


.012809 


,0128 


.00498649 


.00747794 


.00958726 


.01087 


,0109 


.00430640 


.00647221 


.00831498 


.00945 


,009 


.00378929 


.00570452 


.00734031 


.00835 




.00338292 


.00509941 


.00656988 


.0074 




.00266745 


.00403018 


.00520383 


.0059 




.00220165 


.00333140 


.00430779 


.004 




.00187430 


.00283904 


.00367488 






.00163166 


.00247343 


.00320407 






.00144463 


.00219123 


.00284018 






.00129606 


.00196682 


.00255049 
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n 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

12 

14 

16 

18 

20 



0 = .20 


0 = .10 


0 = .05 


0 = .03 


0 = .01 


.16000000 


.09000000 


.04750000 


.02910000 


.00990000 


.07405936 


.0434201 


.0233439 


.0144022 


.00493 


.0475250 


.028436 


.015429 


,00955 


.003 


.034849 


.02110 


.01151 


.007 




.02746 


.0167 


.0091 






.02265 


.013 


.007 







.0192 .01 

.0167 

.014 

.013 

.01 
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